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Method of bit stream processing 



Field of the invention 

The present invention relates to methods of bit stream processing; in 
particular, but not exclusively, the invention concerns a method of bit stream processing 
when tandem coding is employed, for example bit steam watermarking when tandem coding 
5 is utilized- Moreover, the present invention also relates to apparatus arranged to implement 
the method. Furthermore, the invention also concerns data content which has been processed 
according to the method. 

1 0 Background to the invention 

Processing of data content is generally known. Such processing includes one 
or more of encoding, decoding, encrypting, decrypting, reformatting to mention just a few 
examples. Moreover, such processing can be beneficially implemented in some cases by 
employing tandem encoding-decoding apparatus which will be elucidated in more detail 

15 later. 

In particular, watennarking of data content is known, for example to try to 
prevent unauthorised copying and distribution of audio data content To be effective, such 
watermarking needs to be reliably detectable and yet not degrade the quality of the data 
content perceptibly when watermarked la Fig. 1, there is shown a schematic diagram of 

20 signal processing stages implemented in a known contemporary watermarking apparatus; the 
apparatus is arranged in a tandem configuration as will be described in more detail later. 

The stages include a pre-coding stage (PR), and a transcoding watermark 
embedding stage (TWME). Associated with these two stages is an end-user stage (EU) 
where a user decodes encoded watermarked data content b y to regenerate the data content 

25 y[n] for final consumption, for example video and/or audio programme material. In the pre- 
coding stage PR, an input signal x[n] is compressed by a first quantizer Qi to generate a 
compressed bit-stream b x . Moreover, in the watermark embedding stage TWME, the bit- 
stream b x is partially decoded by passing it through a dequantizer invQi to generate a 
partially decoded bit-stream x'[n]. The embedding stage TWME also includes a combiner 
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(COM) which is operable to combine the partially decoded bit-stream x ! [n] with a watermark 
signal w[n] to generate a corresponding watermarked intermediate signal y'[n]. In sequence 
after the combiner COM, the embedding stage TWME also includes a second quantizer Q 2 
which is arranged to receive the intermediate signal y f [n] from the combiner COM and 
5 generate the watermarked data content by. At the end-user stage EU, there is included a 
decoder invQ 2 for receiving the watermarked data content by to generate the data content 
y[n]. The watermarked data content by is susceptible to being conveyed to the user (EU) by 
way of a communication network, for example the Internet, or by way of a data carrier such 
as an optically-readable memory disc, 

10 As a result of the combiner COM, the signal y*[n] is dissimilar to the input 

signal x'[n]. The combiner COM is designed to contribute as little distortion as possible so 
that y ! [n] and x ! [n] are substantially indistinguishable. The inventor has appreciated that the 
stages illustrated in Fig. 1 are also susceptible to introducing additional distortion as a 
consequence of tandeming, namely cascading, the two quantizers Qi, Q 2 . However, the 

1 5 inventor has also identified that such additional distortion due to tandeming does not 
substantially arise when the quantizers Qi, Q 2 are similar. However, in most 
implementations of the stages in Fig. 1, for example in electronic music delivery (EMD) 
systems, tandeming distortions are encountered. 

Such distortion can be affected by employing higher bit-rates at the first 

20 quantizer Qi, for example in a manner of oversampling. When the pre-coding bit rate in the 
first quantizer Qi is dissimilar to that of the second quantizer Q 2 , the quantizers Qi, Q 2 
behave independently resulting in extra noise being introduced in comparison to a situation 
where only the second quantizer Qz is employed. 

Moreover, such distortions can also be affected when identical bit-rates are 

25 utilized at the first quantizer Qi and the decoder invQ 2 at the user end EU. For example, in 
audio coding systems, a so-called psycho-acoustic model is computed from the input signal 
x[n]. As a consequence of subsequent signal processing in the combiner COM and the first 
quantizer Qi, the signal y^n] input to the second quantizer Q 2 is generally different from the 
input signal x[n] provided to the first quantizer Qi. Consequently, scale factors of the 

30 quantizers Qi, Q 2 are generally different which are susceptible to giving rise to additional 
quantization noise. 

Thus, in contemporary bit stream watermarking systems, for example the 
aforesaid electronic music delivery (EMD) systems, tandeming problems are encountered. In 
these systems, audio data content corresponding to the bit-stream b x is stored in some 
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compressed format, for example as AAC, MP3 or similar, after which it is at least partially 
decoded and then embedded with watermark data. The at least partial re-encoding of the 
watermarked data content often degrades audio signal quality more than would be expected 
merely as a consequence of including watermarking data alone. In order to reduce such 
degradation to ensure that audio is delivered at a desired quality, the inventor has envisaged 
that it is desirable to use bit rates for pre-encoded signals, namely for the signal bx, that are 
higher than the bit-rates utilized for the watermarked signal by. Although signal quality can 
be enhanced by such a selection of bit-rates, additional storage capacity is required which can 

be prohibitively costly. 

Approaches to reducing distortion introduced into encoded signals subject to 
signal processing such as watermarking have been previously published. For example in an 
international PCT application no. PCT/EP00/09771 (WO 01/26262), there is described a 
method in which a data stream is initially processed to obtain spectral values for the short- 
term spectrum of an audio signal. Additionally, information to be introduced into the data 
stream relating to spectral values representing a short-term spectrum of the audio signal is 
subjected to a spread sequence for obtaining an expanded information signal leading to the 
creation of a spectral representation of the expanded information signal including scale factor 
information. This representation is then weighted using a determined psychoacoustic noise 
energy which can be masked to generate a weighted information signal in which the energy 
level of the introduced information is substantially equal to or lies below the psychoacoustic 
masking threshold. The information signal and the spectral values for the short-term 
spectrum are subsequently totalled and then re-processed to obtain a processed data stream 
comprising both the audio information and the information to be introduced. In order for the 
information to be introduced without having to pass into the time domain, the block raster 
which underlies the short-term spectrum is not infringed, so that the introduction of a 
watermark leads to a reduced tandem distortion effect. However, the method does not allow 
for substantial suppression of tandem effects but merely a reduction in their relative 
magnitude on account of appropriately using scale factor information. In contradistinction, 
the present invention potentially allows for substantially suppressing tandem effects entirely. 

Summary of the invention 

An object of the invention is to provide an improved method of bit stream 
processing, for example watermarking, when tandem coding is employed, the method being 
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operable to reduce distortion caused by quantization errors arising when undertaking such 
processing. 

According to a first aspect of the present invention, there is provided a method 
of bit stream processing in a tandem coding system, the method including steps of: 

(a) arranging for the system to comprise a series of stages including first 
quantizing means for processing an input signal to generate an intermediate signal, and 
second quantizing means for processing the intermediate signal to generate a processed 
output signal; 

(b) arranging for the first quantizing means to include means for predicting 
distortions arising in subsequent stages of the system and generating one or more 
corresponding quantization noise reduction parameters; and 

(c) applying said one or more noise reduction parameters in at least one of the 
subsequent stages for reducing noise and/or distortion arising within the system. 

The invention is of advantage in that use of the reduction signal is capable of 
enhancing noise performance of the system. 

Preferably, in the method, the one or more noise reduction parameters are 
derived using a cost function applicable to determine when overall quantization noise is 
m ini miz ed. Such derivation of the one or more parameters is beneficial in ensuring that the 
system automatically adjusts itself to exhibit lower noise and/or distortion. 

Preferably, in the method, the system includes combining means arranged to 
embed a watermarking signal into the intermediate signal so that the processed output signal 
is a watermarked output signal. 

Preferably, the method further comprises a step of arranging for the first 
quantizing means to derive one or more parameters for controlling the combining means for 
reducing quantization noise arising thereat in operation. By using such an arrangement, the 
combining means is capable of providing synergistic benefits of, for example, adding 
watermarking information whilst simultaneously providing noise reduction. More 
preferably, the one or more parameters are derived using a cost function applicable to 
determine when overall quantization noise is minimized. 

Preferably, in the method, the combining means is arranged to at least partially 
decode the intermediate signal and then embed the watermarking signal therein. One benefit 
of insertion of watermark content in partially decoded signals that are subsequently re- 
encoded is that it is susceptible to rendering watermark information less immediately evident 
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to counterfeiters and therefore potential assists to deter unauthorised copying of the output 
signal, for example when conveyed by way of a data carrier as digital data content. 

Preferably, in the method, at least one of the one or more noise reduction 
parameters corresponds to a transcoding quantization error determined from a difference 
5 between: 

(a) quantization noise arising in the second quantizing means; and 

(b) a difference in quantization noise generated by a tandem combination of the 
first and second quantizing means. 

Such a manner of generating the one or more reduction parameters is found by the inventors 

10 to provide more favourable noise reduction. 

Preferably, in the method, at least one of the first and second quantizing means 
is arranged to including logarithmic signal quantizing means. A comparison of Figs. 6 and 8 
illustrate very clearly that the invention is capable of providing especially effective noise 
reduction when logarithmic quantization is employed in comparison to linear quantization. 

1 5 Preferably, in the method, the first quantizing means is arranged to operate at a 

higher bit rate than the second quantizing means. Such an operating arrangement is capable 
of providing enhanced system performance by reducing system noise arising from tandem 
coding. 

Preferably, in the method, at least one of the first and second quantizing means 
20 is replaced with a multimedia signal encoding unit More preferably, the multimedia signal is 
an audio signal and the encoding unit is an audio encoder. Alternatively, the multimedia 
signal is a video signal and the encoding unit is a video encoder. 

Preferably, in the method, at least one of the first and second quantizing means 
are arranged in operation to have quantizing characteristics which are dynamically 
25 changeable in response to the nature of the input signal to the first quantizing means. 

Preferably, in the method, the input signal and the output signal are of 
mutually different format. Such different format is of advantage in that the system is capable 
of translating programme content data from one format to another. More preferably, the 
method is such that the system is operable to convert between contemporary MP3 and AAC 
30 signal formats and vice versa. 

According to a second aspect of the invention, there is provided a system for 
executing bit stream processing in tandem coding, wherein the system comprises a series of 
stages including first quantizing means for processing an input signal to generate an 
intermediate signal, and second quantizing means for processing the intermediate signal to 
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generate a processed output signal, and wherein the first quantizing means is arranged to 
include means for predicting distortions arising in subsequent stages of the system and 
generating one or more corresponding quantization noise reduction parameters , and wherein 
the system is operable to apply the one or more reduction parameters in at least one of the 
subsequent stages for reducing noise and/or distortion arising therein. 

Preferably, the system includes combining means for embedding a 
watermarking signal into the intermediate signal so that the processed output signal is a 
watermarked output signal. 

It will be appreciated that features of the invention are susceptible to being 
combined in any combination without departing from the scope of the invention. 

Description of the diagrams 

Embodiments of the invention will now be described, by way of example only, 
with reference to the following diagrams wherein: 

Fig. 1 is a schematic diagram of signal processing stages implemented in a 
known contemporary watermarking apparatus; 

Figs. 2a, 2b, 2c are illustrations of quantizer configurations for comparing 
effects of tandem coding; 

Fig. 3 is a schematic diagram of a simple logarithmic quantizer, Qi og ; 

Fig. 4 is a graph representing a logarithmic transformation L; 

Fig. 5 is a graph representing a typical behaviour of a tandem noise reduction 
(TOR) cost function; 

Fig. 6.is a graph depicting tandem noise energy for two cascaded quantizers 
Qiiog, Q2iog for situations of with tandem noise encoding and without tandem noise encoding; 

Fig. 7.is a schematic diagram of a simple linear quantizer Q iin ; 

Fig. 8 is a graph of energy of tandem noise for two cascaded linear quantizers 
Qiiin, Q2iin for situations of with and without tandem noise coding; and 

Fig. 9 is a schematic diagram of a generic embodiment of the invention. 

Description of embodiments of the invention 

In the following description, a brief analysis of quantization eixor is provided 
after which embodiments of the invention are elucidated. 
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» 

It is known that quantization error arising from quantizing a signal x[n] is 
susceptible to being modelled in a statistical manner if the signal x[n] is sufficiently 
"complex" and a quantization step S associated with quantization is sufficiently small; in 
other words, modelling can be beneficially applied as the correlation between the signal x[n] 
5 and the quantization error decreases. For two linear quantizers Qi, Q 2 arranged in a tandem 
configuration and having corresponding quantization steps Ai, A2 respectively, a quantization 
noise e[nj of each of the quantizers is in range as provided in Equation 1 (Eq. 1): 




Eq. 1 



10 

where A is a quantization step size. 



For small steps A, the noise e[n] can be assumed to be a random variable 
which is uniformly distributed over its interval, has a mean of zero and a variance as 
15 provided in Equation 2 (Eq. 2) based on an analysis of Oppenheim and Schafer 1989, 
"Discrete-Time Signal Processing", published in Prentice Hall Signal Processing Series, 
ISBN 0-13-754920-2: 



20 



For a quantizer operable to provide a resolution of (B+l) bits and arranged to 
provide a full-scale dynamic range X m (i.e., X m =2 B A), a variance of noise is given by 
Equation 3 (Eq. 3): 



25 



12 



Eq. 



30 



From Equation 3, the noise generated by a tandem series of two cascaded 
independent quantizers Qi, Q2 having a mutually identical quantization step A and a dynamic 
range X m is given by Equation 4 (Eq. 4): 
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p e(l,2) 



__ ^ w m 



12 



12 



Eq.4 



The noise described by Equation 4 is also capable of being expressed as a 
signal-to-noise ratio SNR in dB as provided by Equation 5 (Eq. 5): 



SNR = lOlog 



10 



fa? 



= 6.02 + 7.79- 20 log 10 



'JO 



Eq.5 



The signal-to-noise ratio determined from Equation 5 for the two quantizers 
Qi, Q2 is approximately 3 dB more noisy, wherein 3 dB=101ogi 0 (2), in comparison to only 
one quantizer, for example solely the quantizer Q 2 . The present invention is susceptible to 
improving the SNR provided by a tandem configuration of two quantizers Qi, Q 2 , namely 
enhancing the SNR by up to 3 dB. 

In describing embodiments of the present invention, it is assumed that there is 
provided a transcoding configuration including the two quantizers Qi, Q 2 which are not 
mutually identical. The invention exploits a characteristic that the a priori knowledge of the 
characteristics of the quantizer Q 2 in the pre-coding stage (PR) can be used to generate noise 
reduction parameters that can assist the second quantizer Q 2 to reduce tandem quantization 
noise (TQN) arising therein; such tandem quantization noise will be elucidated in more detail 
later. 

TQN will now be described in more detail with reference to Fig. 2. 

In Fig. 2a, there is shown a quantizer Q 2 arranged to receive an input signal 
x[n] and generate a corresponding quantized signal yQ 2 [n]. A configuration presented in Fig. 
2a resembles the quantizer Q 2 in the embedding stage TWME illustrated in Fig. 1 . 

In Fig. 2b, there is included two quantizers Qi, Q 2 coupled in series, namely in tandem, for 
processing an input signal x[n] presented to the quantizer Qi to generate an intermediate 
signal yQi[n] which is further processed in the quantizer Q 2 to generate an output signal 
yQi2[n]. The quantizer Qi in Fig. 2b resembles the quantizer Qi in the pre-coding stage (PR) 
in Fig. 1. The output signal y Q i 2 [n] in Fig. 2b is quantized twice and therefore subject to a 
degraded SNR in comparison to Fig. 2a where only a single quantization process is invoked 
The present invention is susceptible to improving the SNR for the configuration of Fig. 2b to 
approach that of the configuration of Fig. 2a, especially in a context of watermarking 
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information being applied However, the present invention is more broadly applicable to 
tandem configuration and not limited to watermarking systems. 

In Fig. 2c, there is illustrated an embodiment of the invention. There is shown 
a configuration wherein an input signal x[n] is coupled to inputs of first quantizers Qi, Q2 and 
also to an input of a tandem noise reduction unit (TNRU). Outputs of the first quantizers Qi, 
Q 2 are coupled to additional inputs of the TNRU, for example an output y Q i [n] of the first 
quantizer Qi is coupled to the TNRU and also to an input of a second quantizer Q 2 . An 
output control signal CQ2[n] generated in operation by the TNRU is coupled to a further 
input of the second quantizer Q2 which is operable to process the signals yQi[n] and CQ2[n] 
to generate a quantized output signal yQTc[n]. In operation, the TNRU is used to estimate 
the control signal CQ2[n] for the second quantizer Q2 in such a maimer as to reduce the total 
quantization noise in the output signal yQ T c[n]. The embodiment of the invention illustrated 
in overview in Fig. 2c is capable of being implemented using at least one of linear quantizers 
and logarithmic quantizers. For more fully elucidating the present invention, such types of 
quantizers will now be described in farther detail. 

In Fig. 3, there is shown a logarithmic converter Qi og . The logarithmic 
converter Qi og comprises a normalization unit (N), a logarithmic transform unit (L), and a 
linear quantizer (LQ) coupled in series as illustrated. The normalization unit N is arranged to 
receive an input signal x[n] and provide a corresponding normalized output signal x n . 
Moreover, the transform unit L is arranged to receive the normalized signal and provide a 
corresponding transformed signal y n . Furthermore, the quantizer LQ is arranged to receive 
the transformed signal y n and generate a corresponding quantized signal y qn . 

In a similar manner to the foregoing wherein a tandem series coupling of two 
quantizers was considered, such a coupling of two logarithmic converters of a type as 
illustrated in Fig. 3 is also of relevance to the present invention. By way of example, 
consider two such logarithmic converters Qn og and Q2iog described by a transform shown in 
Equation 6 (Eq. 6): 

= log(l+jSQ Eq.6 

y " iog(*:+i) 

where K is a positive large number; for example, K=30 for the quantizer Qn 0 g and K=30.1 for 
the quantizer Q 2 i og . A qualitative graphical presentation of Equation 6 is provided in Fig. 4 in 
which y n is plotted against x„. 
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An additional constraint can be applied to the two quantizers Qn og , 
namely that these two quantizers have resolutions of wi, W2 bits respectively according to 
Equation 7 (Eq. 7): 

5 w i = 2w 2 Eq.7 

Thus, in an embodiment of the invention, the quantizers Qn og , Q2i og are 8-bit 
and 4-bit quantizers respectively. However, other word lengths and ratios for wi, w 2 are 
feasible. 

10 The quantizers Qn og , Q2iog are susceptible to being employed in configurations 

as depicted in Fig. 2a, 2b, 2c. For example, the quantizers Qn og , Q2io g can be used for the 
embodiment of the invention as depicted in Fig. 2c. Thus, by such substitution, the two 
logarithmic quantizers Qn og , Q2io g are coupled in tandem, namely in series, without TNRU 
noise reduction whereas the quantizers Qu og , Q 2 i og are coupled with YNRU noise reduction in 

15 Fig. 2c. 

Data for use in noise reduction in the configuration depicted in Fig. 2c, namely 
data for producing the signal CQ2[n], is generated by utilizing an offset function g(q) where 
q is one or more arguments, to reduce a difference between the signals yQ2[n] and yQuM in a 
least squares sense according to Equation 8 (Eq. 8): 



20 



25 



<K<X) = E(y fi 2[»]-fi2 to8 {)>^ Eq. 8 



where Chio g {x} is employed to denote the quantizer Q2i og applied to the signal x. Preferably, 
the offset fimction g{q} is selected to be according to Equation 9 (Eq. 9): 

g(<*>y Q i)=2~*y Q i Eq.9 



Determination of a minimum value for Equation 8 for a condition wi = 8 bits 
is depicted in Fig. 5; a value generated by Equation 8 and as illustrated in Fig. 5 is also 
30 known as a "cost function". 

It is also feasible to determine variances on and Otnrc of tandem noise signals 
for the configuration of Fig. 2c where minimization of the aforementioned cost function is 
implemented for achieving noise reduction as depicted in Fig. 6; a curve 100 corresponds to 
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no TNR correction, whereas a curve 1 10 corresponds to TNR correction applied. Along an 
abscissa axis in Fig. 6 is marked number of bits for the quantizer Qn og (NB F Qn og ) and along 
an ordinate axis is normalized tandem noise energy (NTNE). It will be appreciated from Fig. 
6 that use of TNR correction as depicted in Fig. 2c is effective at reducing noise energy. In 
5 Fig. 6, the variances On and Gtnrc of the resulting tandem noise signals are determinable 
form Equations 9 and 10 (Eq. 9 and 10): 

c^ 12 =E(y, 12 W-^ 2 W) 2 Eq.9 

n 

n 

It will be further appreciated that TNR is also susceptible to being applied in 
the configuration of Fig. 2c when linear quantizers are employed therein. A linear quantizer 
Qiin is depicted in Fig. 7 and comprises a normalizing unit (N) coupled in series with a linear 

15 quantizing unit (LQ). In Fig. 7, the linear quantizer Qim is arranged to receive a signal X and 
normalize this signal X to generate a corresponding normalized signal X n . Subsequently, the 
normalized signal X n is quantized in the quantizing unit (LQ) to generate a corresponding 
normalized quantized signal X qn . The quantizer Qim of Fig. 7 is capable of being 
incorporated into the configuration of Fig. 2c with a constraint of Equation 7 applied. As 

20 before, an offset function is used for a least squares minimization to determine best operating 
conditions, the offset function for the linear quantizer Qiia as defined in Equation 1 1 (Eq. 1 1): 

g(oc,y G1 )=g(«) = 2- Eq.ll 

25 Variances 012 and Otnrc of tandem noise signals for the configuration of Fig. 

2c where minimization of the aforementioned cost function are as provided by Equations 12 
and 13 (Eq. 12, 13): 



30 



n 



Eq. 12 



PHNL04009 1 EPP 



12 16.01.2004 
Vtnrc =Et f fcW-y«2W) a Eq. 13 



In Fig. 8, there is presented a graph of normalized tandem noise energy 
(NTNE) against number of bits resolution for the initial quantizer Qmn in the configuration of 
Fig. 2c. A curve 200 in Fig. 8 corresponds to a tandem configuration without tandem noise 
reduction (TNR) whereas a curve 210 concerns the tandem configuration of Fig. 2c with 
TNR. It will be appreciated from Fig. 8 that TOR applied to the configuration of Fig. 2c 
using linear quantizers is also capable of yielding noise reduction; however, the benefits are 
not as great as Fig. 6 for logarithmic quantizers. 

The configuration of Fig. 2c including TNR is susceptible to being 
incorporated into the watermarking apparatus depicted in Fig. 1 to yield an embodiment of 
the invention illustrated schematically in Fig. 9, namely a watermarking apparatus indicated 
generally by 300. The apparatus 300 includes a pre-coding section (PR) and a transcoding 
watermark embedding section (TWME). The apparatus 300 is operable to receive an input 
signal x[n] and to apply a watermark signal w[n] thereto whilst also encoding the 
watermarked input signal x[n] to generate a corresponding encoded watermarked signal by. 
An end user (EU) is capable of receiving the signal by, for example conveyed by way of a 
communication network and/or a data carrier such as at least one of an optical disc ROM, a 
magnetic hard disc and a solid state electronic memory device. The end user (EU) is capable 
of decoding the signal b y to generate a final decoded signal y'[n] for consumption by the user. 
In the apparatus 300, quantizers employed therein, for example the quantizers Q x , Q 2 and 
their corresponding inverse functions invQi, invQ 2 , can be either of logarithmic or linear type 
as described in the foregoing. The apparatus 300 is preferably optimized using the aforesaid 
cost function to provide an enhanced degree of noise reduction. In the apparatus 300, the 
input signal x[n] is coupled to inputs of first quantizers Qi, Q 2 . An output b x of the first 
quantizer Qi is coupled to an input of the tandem noise reduction unit (TNRU) and also to an 
input of a decoding function invQi. Moreover, a quantized output of the first quantizer Q 2 is 
coupled to another input of the TNRU. The decoding function invQi is operable to at least 
partially decode the signal b x to generate an intermediate signal x f [n] which is merged with a 
watermark signal w[n] in a signal combiner (COM) to generate a corresponding intermediate 
watermarked signal y[n]. The watermarked signal y[n] is received at a second quantizer Q 2 
which, under control of a tandem data signal t[n] generated by the TNRU, generates the 
encoded watermark signal b y . 



PHNL04009 1 EPP 



13 16.01.2004 
In operation, the TNRU codes a measure of the difference between the two 
first quantizers Qi, Q2 and transmits tandem data t[n] to 1he second quantizer Q 2 , where in 
one preferred case the measure of the difference is the difference itself. In a modified 
version of the apparatus 300, the watermark signal w[n] is embedded in both the tandem data 
5 t[n] and the intermediate signal x f [n]. In a yet further modified version of the apparatus 300, 
the tandem data signal y [n] is digitized in the TNRU and appropriately combined with the 
signal b x . 

Other alternative embodiments of the invention are possible. For example, the 
two quantizers in Fig. 2 can be replaced with audio or video coding units having the same or 

10 different coding formats or bit-rates; the pre-coding section PR and the watermarking section 
TWME may be constructed with a set of possible quantizers such that parameters of the input 
signal x[n] are used for selecting an appropriate quantizer from the set to employ at any given 
instance; in other words, the apparatus 300 can be provided with quantizers whose 
characteristics are dynamically alterable in response to characteristics of the input signal x[n], 

15 thereby providing enhanced watermarking and/or improved noise reduction. Preferably, the 
pre-coder PR then does not need to encode a difference between the two first encoders Qi, Q 2 
but can simple provide a pointer to a subsequent quantizer at a secondary stages in the 
apparatus 300 corresponding to the first quantizers Qi, Q2. The pointer is beneficially 
employed in the TWME. 

20 The inventors have envisaged that the present invention also relates to bit- 

stream watermarking apparatus of a form generally similar to the apparatus 300 but where the 
bit-stream signal b x only needs to be transcoded into a different bit rate without a need to 
embed watermark information. In such an apparatus, the watermarking COM stage is 
absent so that y[n]= x'[n], 

25 Other embodiments of the invention are possible. For example, the apparatus 

300 can be adapted to utilize different bit-rates at its pre-coding PR stage and its embedding 
stage TWME. The transcoding in the TWME stage can be implemented for bit-rate 
reduction. Alternatively, the transcoding in the TWME stage can be arranged for processing 
in an at least partially decoded domain, for example for at least one of watermarking, image 

30 enhancement such as colour reinforcement, image detail edge enhancement and so forth. As 
a further option, transcoding performed in the TWME stage can be for purpose of changing 
bit-stream format, for example from proprietary AAC format to MP3 format These 
alternative adaptations of the apparatus 300 can be implemented in any combination. 
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As a yet further option, identical bit-rates can be employed in pre-coding PR 
and transcoding TWME stages of the apparatus 300. Such similar bit-rates are relevant for 
processing at least partially decoded signals, for example as in watermarking and/or 
transcoding for changing bit-stream format, for example from AAC to MP3 standards. 

The invention is of benefit in that additional noise arising due to quantization 
in tandem configurations can be potentially reduced. Such noise reduction can also be used 
as an approach to reduce numbers of bits required to represent a signal whilst maintaining a 
given level of quantization noise. 

The present invention is especially pertinent to electronic music delivery 
(EMD) systems where digital data content corresponding to items of music, for example 
popular songs, downloaded from a communication network such as the Internet is stored in a 
compressed format, for example in one or more of AAC or OCS formats, in a database, for 
example in a user's music collection stored on a hard disc drive memory. In generating such 
an item of music, an original music signal has been subject to a first quantizer, equivalent to 
the first quantizer Qi in the apparatus 300, to generate first compressed quantized data, 
equivalent to the signal bx, maintained by a music provider. When a purchaser pays the 
provider for a copy of the quantized data corresponding to the item, the provider at least 
partially decompresses the desired quantized data, then watermarks the at least partially 
decompressed desired data and then again compresses the now watermarked desired data. 
The latter compression is equivalent to the second quantizer Q 2 in the apparatus 300. To 
preserve quality at the provider site, for example at a data server linked to the Internet, the 
first quantizer Qi thereat is usually arranged to have a higher resolution, namely higher bit- 
rate and/or finer quantization, than the second quantizer Q2. In such a scenario, the invention 
is applicable to exploit insight that the provider has knowledge of the quantizer Q2 and thus 
has knowledge of the desired output level y Q2 , see Equation 8 in the foregoing. This 
knowledge can be used for implemented tandem noise reduction (TOR) according to the 
invention as described in the foregoing, for example to generate a scale fector and/or offset 
by which the intermediate level y Q i is modified such that the second quantizer Q 2 produces a 
desired level y Q2 instead of y Q i 2 . 

It will be appreciated that embodiments of the invention described in the 
foregoing are susceptible to being modified without departing from the scope of the invention 
as defined by the accompanying claims. 

Expressions such as "comprise", "include", "incorporate", "contain", "is" and 
"have" are to be construed in a non-exclusive manner when interpreting the description and 
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its associated claims, namely construed to allow for other items or components which are not 
explicitly defined also to be present. Reference to the singular is also to be construed to be a 
reference to the plural and vice versa. 
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CLAIMS: 



1 . A method of bit stream processing in a tandem coding system (300), the 
method including steps of: 

(a) arranging for the system (300) to comprise a series of stages including first 
quantizing means for processing an input signal to generate an intermediate signal, and 

5 second quantizing means for processing the intermediate signal to generate a processed 
output signal; 

(b) arranging for the first quantizing means to include means for predicting 
distortions arising in subsequent stages of the system and generating one or more 
corresponding quantization noise reduction parameters; and 

10 (c) applying said one or more noise reduction parameters in at least one of the 

subsequent stages for reducing noise and/or distortion arising within the system (300). 

2. A method according to Claim 1, wherein said one or more noise reduction 
parameters are derived using a cost function applicable to determine when overall 

15 quantization noise is minimized. 

3. A method according to Claim 1, wherein the system (300) includes combining 
means arranged to embed a watermarking signal into the intermediate signal so that the 
processed output signal is a watermarked output signal. 

20 

4. A method according to Claim 3, the method further comprising a step of 
arranging for the first quantizing means to derive one or more parameters for controlling the 
combining means for reducing quantization noise arising thereat in operation. 

25 5. A method according to Claim 4, wherein the one or more parameters are 

derived using a cost function applicable to determine when overall quantization noise is 
minimized. 
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6. A method according to Claim 4, wherein the combining means is arranged to 
at least partially decode the first intermediate signal and then embed the watermarking signal 
therein. 

7. A method according to Claim 1, wherein at least one of said one or more noise 
reduction parameters corresponds to a transcoding quantization error determined from a 
difference between: 

(a) quantization noise arising in the second quantizing means; and 

(b) a difference in quantization noise generated by a tandem combination of the 
first and second quantizing means. 

8. A method according to Claim 1 , wherein at least one of the first and second 
quantizing means is arranged to including logarithmic signal quantizing means. 

9. A method according to Claim 1, wherein the first quantizing means is arranged 
to operate at a higher bit rate than the second quantizing means. 

10. A method according to Claim 1, wherein at least one of the first and second 
quantizing means are arranged in operation to have quantizing characteristics which axe 
dynamically changeable in response to the nature of the input signal to the first quantizing 
means. 

11. A method according to Claim 1, wherein at least one of the first and second 
quantizing means is replaced with a multimedia signal encoding unit. 

12. A method according to Claim 11, wherein said multimedia signal is an audio 
signal and said encoding unit is an audio encoder. 

13. A method according to Claim 11, wherein said multimedia signal is a video 
signal and said encoding unit is a video encoder. 

14. A method according to Claim 1 1 , wherein the input signal and the output 
signal are of mutually different format. 
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15. A method according to Claim 14, wherein the system (300) is operable to 
convert between MP3 and AAC signal formats and vice-versa. 

16. A system (300) for executing bit stream processing in tandem coding, wherein 
5 the system comprises a series of stages including first quantizing means for processing an 

input signal to generate an intermediate signal, and second quantizing means for processing 
the intermediate signal to generate a processed output signal, and wherein the first quantizing 
means is arranged to include means for predicting distortions arising in subsequent stages of 
the system and generating one or more corresponding quantization noise reduction 
10 parameters, and wherein the system (300) is operable to apply the one or more reduction 

parameters in at least one of the subsequent stages for reducing noise and/or distortion arising 
therein. 



15 



17. A system (300) according to Claim 16, including combining means for 

embedding a watermarking signal into the intermediate signal so that the processed output 
signal is a watermarked output signal. 
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ABSTRACT: 



The invention concerns a method of bit stream watermarking in a tandem 
coding system (300). The method involves arranging for the system (300) to comprise a 
series of stages including a first quantizing unit for processing an input signal to generate a 
first intermediate signal, a combining unit for embedding a watermarking signal into the 

5 intermediate signal to generate a second intermediate signal, and a second quantizing unit for 
processing the second intermediate signal to generate a watermarked output signal. The first 
quantizing unit to arranged to include a unit for predicting distortions arising in subsequent 
stages of the system (300) and generating one or more corresponding quantization noise 
reduction parameters. Moreover, the system (300) is operable to apply the one or more 

10 reduction parameters in at least one of the subsequent stages for reducing noise and/or 
distortion arising within the system (300). 



Fig. 9 



PHNL040091 

1/9 





w[n] 




PHNL040091 



2/9 




yc»[n] 



x[n] 




Fig. 2b 



x[n] 



Fig. 2c 



YqiN 



■• *#^i§& ' -wfsl^L -life 



CQ2[n] 



• TNRU 





YQi2[n] 




YQTc[n] 




PHNL040091 



3/9 



Qlog 



■ - 



IS! 




Xn 





▼ Yqn 



Fig. 3 



PHNL040091 



4/9 




Fig. 4 



PHNL040091 

5/9 




23456789 

a 



Fig. 5 



PHNL040091 

6/9 




4 5 6 7 8 9 10 11 12 13 14 



NB F Q 1IO! 



Fig. 6 



PHNL040091 



7/9 



Qlin 



Nf? JUS < |#i ' - Iffe, < 1 








■ - 



Fig 



PHNL040091 



8/9 

NTNE 




4 5 6 7 8 9 10 11 12 13 14 

NB F Q 1lin 



Fig. 8 



PHNL040091 



9/9 



300 




PCT/IB2005/050155 




This Page is Inserted by IFW Indexing and Scanning 
Operations and is not part of the Official Record. 



Defective images within this document are accurate representations of the original 
documents submitted by the applicant. 

Defects in the images include but are not limited to the items checked: 



jfi BLACK BORDERS 

□ IMAGE CUT OFF AT TOP, BOTTOM OR SIDES 

□ FADED TEXT OR DRAWING 

□ BLURRED OR ILLEGIBLE TEXT OR DRAWING 

□ SKEWED/SLANTED IMAGES 

□ COLOR OR BLACK AND WHITE PHOTOGRAPHS 

□ GRAY SCALE DOCUMENTS 



fX REFERENCE(S) OR EXHIBIT(S) SUBMITTED ARE POOR QUALITY 
□ OTHER: __ 



IMAGES ARE BEST AVAILABLE COPY. 
As rescanning these documents will not correct the image 
problems checked, please do not report these problems to 
the IFW Image Problem Mailbox. 



BEST AVAILABLE IMAGES 





LINES OR MARKS ON ORIGINAL DOCUMENT 



